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ABSTRACT 

A model for augmenting the impact of the community 
college reading instructor within the institution is presented in 
this paper. Reported are the actual findings and the criteria used 
in: (1) the assessment of the reading levels of students enrolled in 
three courses at the college of DuPage in Glen Ellyn, Illinois; (2) 
the evaluation of the readability of the texts used in the courses; 
and (3) determination of how the instrix:tcrs used and augmented the 
texts. Six sections of students enrolled in three vocational courses 
taught by S3ven instructors served as the study population. The 
reading comprehension levels of the students were determined by the 
Gates'MacGinitie Reading Test, Comprehension Subtest. The readability 
of each textbook used was determined by applying a computerized 
version of the Dale-chall Formula. A 219* item survey was used to 
evaluate the knowledge and attitudes of the instructors with respect 
to reading and text use. Analysis of student scores, text readability 
levels, and instructor surveys prompted the instructional personnel 
involved to modify their course offerings to better fit their 
students* needs. Due to the benefits gained by faculty and students 
from the study, the program has been adopted for general use at the 
College of DuFage. (TO) 
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A Replication in Vocational Reading: 
The Project and the Criteria Used to 
Determine the Feasibilii^ of Replication' 

hy Mary J. Van De Marker^ 



Introduction 

Reading consultants in conmnmitj colleges can find themselves in 
peculiar situations. If their instruction is confined to the classroom 
or learning lab, they are likely to find themselves instructing classes of 
students with "problams" in reeuling. In other words, the stuc'ents come 
for assistance after the damage has been done. It would seem to be a greater 
service to students to alert instiructors in the content areas to the actual 
communication/reading demands placed on students in the areas and to alert 
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students to the conmimicat ion/reading demands placed on them in these areas* 
The reading consultant is then confronted vlth the idiole question of vhat 
kinds end levels of communication are being used In the courses at the college* 
Several problems become liomedlately evident • An obvious one is to detexialne 
the level at vbich the students cure' conaminicating/readlng* Another obvious 
problem is to determine the level and methods of the instructors* ccmmunlcation* 
The reading Instructor can be of greatest value to students by beccmilng part^ 
in some wy, of the commanlcetion occurring betveen the content area Instructor 
and the stxident* This is not an easy thing tc do« In searching for vays to 
be of service to students and Instructors both^ it i^peared to the author that 
a program having the following coasponents would, in some cases^ provide 
entrance: - 

!• Assessment of the reading 3jevel8 of th«» fltu4«-nta enrolled in 
a given course at the college* 

2* Evaluation of the readability of the texts tised in the course* 

3* Determination of how the instructors used and augiiented the texts* 
The Vocational Reading Power Project (VRPP) described by Butz et al* ( 3) and 
But2 (2) has focused on these three basic activities at the vocational hii^i 
school level* In the project repox:ted here^ then^ the reading consultant's 
objective coincided with those of the VBPP« 

This paper differs from previous reports because it Includes not 
only the results of the project^ but also the criteria used to determine 

libether replication tfasc possible and the outcomes of the replication in terms 

« 

of these criteria* 

It is hoped that both the actual findings of the project and the cri- 
teria used^ will provide a model for au^nenting the Ijiqpact of the comminlty 
eolle$ i reading instructor within the institution* 



3 

Replication procedure* 
Qyervlev * The following major components of the VRPP vere replicated: 

!• The reading coaprehenelon levels of coommlty college students 
enrolled in three courses at the College of DuPage vere detexialned 1^ the 
Oates^KacGlnltle Reading Tests Survey Comprehension Subtest (3)* 

2# The reading difficulty levels (''readabilities**) of three textbooks 
and one study guide used by these students vere assessed by applying a com- 
puterized version developed by Butz and Joos (1^ 6, T) of the Dale-Chall 
readabiUty foxnula {h). 

3« The readability levels of the texts vere coi^iared vith the 
reading comprehension levels of students using the texts* 

k. A 219-item survey vas used to evaluate the knovledge and ^ 
attitudes of seven instructors t e ac h ing the three courses vith respect to reading 
and text use* 

Subjects * Six different grot^s of students participated In the study* There 
vere fifteen, thlrty-tvo, and thlrty-tvo students, respectively enrolled In 
three sections of Air Condltlonl^; seventy*three and thirty-nine students 
In tvo sections of Data Processing; and eighteen students enrolled In one 
section of Radiologic Technology* The total ncuBber of students vas 206* 
All of these courses vere at the firesbtdan level* 

Instructors * Each of the seven Instructors participating in the study had 
had considerable experience both In his oceiqMitlonal area and In teadilng* 
The instructor in the radiologic technology course da the coordinator of 
the radiologic technology program* A team of three Instructors, Including 
the coordinator of the program, tauel)^ the data processing course* Tvo menibers 
conducted the emiing session and all three vorked together In the day 
session* Eadi of the sections of air- conditioning vas taught by a different 



instructor* Tbe day session vas tauc^ by the (fUU^tiae) coordinator of 
the program, and the evening and Saturday sections vere each tau£^ by a part- 
tine instructor* 

Texts * The text used In an three sections of the air conditioning course 
vas the Trane Air Conditioning Manual * The text used in both sections of : 
data processing vas Bohl, M* Lsifonaation Ptx>cesslng^ OiicagD: Science Research 
Associates, 1971# snd its acconpanying Study G uide to Infonnation Processing * 
The section of radiologic technology used Selnn, J* ne f^mHfUiMnitals of X*ray 
and Radium Physics * 

Method - student testing* Student testing vas conducted during the Winter 
<kiarter, 1972* All 208 students vere ateinistered the Gates^MacGlnitie . Reading 
Testj Survey Fj Comprehension Subtest (ftam IM) * The reading consultant adnlnistered 
all tests* 

|iBttia& * readability analyses * Sale-Chall readability analyses vere co^^leted 
on eadi of the four text naterials* Thexsaapling strategy vas randoa seqjuen- 
tSeXp vith the ''topic" being the saqpUng unit* (A 'topic*' vas defined 
as a conceptually and structurally eonpUte sub-unit of a diapter; operation- 
ally, topics vere sequences of narrative text, identified hy a boldface-type 
heading, vithln a chapter*) Brery ihth topic from the Trane Air Conditioning 
Manual; every 1^ topic fron the Selaan book; every .9th topic tram the Bohl 
text; and every 6th topic fron the Bohl study guide* 

The saaiples vere edited to conform vith the Instructions of Dale and 
Chall, and vere keypundied onto standard IM data cards* The readability 
analyses vere p^oxved on Oakland Schools* IBM 360*$0 conputer, using the 
Joos-Butz Readability Frogran* ^ 

Method - Instructor survey # Eadi of the seven instructors ooapleted thit VRTO 
ftirvey, and returned it to the reading consultants 



Rewilts - readability analyses # Tbe results of the readability analyses 
<m the text aaterlals are shoim In Table !• It nay be seen that the topics 
in all of the books shoved a vide range in reading difficulty, and that there 
vere considerable differences betveen the "'average*' readability values 
between books* l!be nean readability of the Trane Air Conditioning Manual 
vas significantly lover than the other three books (p<«0$) and the Bohl 
study guide vas significantly hi^er (p<«05)« It is interesting that the 
readability of the Bohl study guide is higher than that of the Bohl text; 
this probably reflects the greater difficulty of the study guide's ""condensed" 
description of the content* It should be noted thaft these vere books selected 
for use in fresbsMOi^level courses; the present analyses indicates that a very 
hig|i level of reading skill vould be required to use the naterials selected 
fbr the data processing and radiologic technology courses* 

Rys^lts - reading tests * The results of the reading test, as shorn in Table 2, 

— ■ ■ — — V — 

indicate that the reading comprehension of the students vas. In general, q^ite 

hi^* Students In the radiologic tedmology course obtained t;he hij^iest 

reading conprehcnslon nean score (l^th grade equivalent); the data processing 

sections had an average equivalent to the ll^th grade level; and the average 

conprehension grade equivalent In the air CMiditlooiag sections vas 11th grade 

(two sections) and 12th grade (one section)* It is notevorthy that the aean 

scores vere very consistent betveen sections of the sane course; this is 

particularly interesting in the case of the thiree air conditioning sections, 

vhich vere quite different vith respect to a|^ ranges and acadenic backgrounds. 

It Bust be aentioned that vlthln each section there vas a considerable 

range of reading test scores; in every section there vere soais students lAio 

scored at or belov 8th grade level, as veil as students idio scored set the level 

of the average college gnduste* 
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Reaults « conparlson of reading test data and text readability data# Table 2 
iliovs the oooparlaoD betveea the readability of the texta and the reading 
ooaprehenslon levels of the students* 

Three conparatlve aeasures vere calculated. 

a« The nean Dale-Cball value of each test vas ooopared vlth the 
aean Cates-lfacGlnltle score of the students (both values e3q>ressed In grade 
eq^lvalents)• Table 2 shows that the aean reading conprdienslcm level of the 
radio l ogic teduiology students vas at least one grade level hlfi^er than the 
■ean reading difficulty level of the text they vere using, and that the nean 
reading test score of the two air conditioning sections was at least one grade 
level hl^tor than the aean reading difficulty level of the Trane wmual* There 
were no other significant differences between the text aeans and the student 
■eans In the other three sections. 

b« Ttable 2 also shows tbB percentsge of students In each section with 
reading cooqnrehenslon scores at least one grade level below the aean reading 
dlf.nculty level of the text* (Since the aean readability valoe for eadi book 
was es^ressed as a con^dence interval^ the percentages were also presented 
in the fbxa of bands*) It aay be seen that In each class there was a oonsld* 

» 

arable nwber of students with reading cooprehenslon scores below the Man 
of their text* 

e* Table 2 also estlnates for each sectioa the percent of topics 
in the text whldi are at or below the level of the average reading coapre he ns lo n 
grade equivalent for students In that section* A table of confidence Intervals 
was used to obtain these percentsges* V^xbBpm the aost appropriate Interpre* 
tatlon of these very conservative statistics Is that In the air conditioning 
sections aost (at least 2/3) of the topics in the text would be at or belcw 
the reading cosprdienslon levels of the ^'ai^rage** students; in the other courses 



there vould probably be a greater percentage of topics above the reading coa- 
prdieiisioii levels of the average student in each section. 
Bcsiilts • instructor survey . An analysis of the seven instructors* responses 
on the VRPP survey indicated that 

a« Six ^: of the instructors responded that the text vas an ?laportant 
and necessary" part of their course. Okie instructor felt that the text vas 
lowidiat ijmport&ot^; the other possible response category, ^toLdb, no instructor 
indicated, vas ""not iaportant.** 

b« All of the instructors rely heavily oti the textbooks in their 
eomseu} all responded that the text vas a) the prinary reference for occu- 
pational theory in their courses, b) the priaary reference for outside assigiSBents, 
taSA c) the sequence of the course folloved the sequence of the text* 

c« Most of the instructors expected their students to read the text 
''independently," i«e«,vlthout help* . 

d« There vere considerable differences anong the instructors as to 
the relative value (usefulness) of various c<nq»onents of their texts (glossary. 
Illustrations, eiqplanation of theory, reviev questions, etc*) 

d« All the Instructors used the reviev questions in the text aa a 
■easure of their students* coaprehension of the text* 

e« Virtually all of the instructors had used and/or developed various 
kinds of laaterials to siq^plenent the text* 

f * All the instructors felt that it vas very iji^ortant for their 
students to "visualixe from a vritten description" and to "apply textbook 
principles to practical application*** Five of the seven instructors surveyed 
felt it vas very inportant tor their students to **recognize vhat is inplied 
as veil as vhat is stated*** 

g* Finally, in response to the q^estioQ; **If you vere selecting 
students for your course, hov inportaat vould you consider the follovingt** 



all the instructors rated ""ftchaiiatic interpretation" as Very iaportant** and 
six of the seven rated ^'reading ability*" and ''self-discipUne*' as Very iq^rtant" 
(the highest evaluation offered)* 

Criteria used to determine the feasibility of replication* 

At the start of the replication ei^ criteria vere established for 

determining idiether such a project vas possible* These criteria vere selected 

because each involves a decision maker or a group of decision makers ^Ao could 

"veto** the replication* They vere: 

I* With reference to the faculty involved In the project 

A* Td determine idiether any of the faculty felt 'Uiat the 
information generated vas north the coiltment 'Uiey vould 
have to make 

B* T6 see if there ver6 any b^Tioral changes on the part of 
the faculty participating 

n* Vlth reference to the faculty no(t directly involved vith the 
project 

A* To determine Interest 

B* To detexmine other uses of the program 

m* With reference to thfi students involved 

A* To see if they felt the project vorthy of their cooperation 

B* To see if Just taking the test lead to an a«ar«iess of 
their reading strengttis and veaknesses 

C* Td see if they acted ugoa rich aweneas 

IV* With reference to tiie ConcMiter Services Department at College of DuFage 

A* To determine lAether readability analyses vere feasible 
vith current equipment and personnel 

B* Td determine idietheiLthe department understood the project 
and its Inqplications 

V* With reference to the administration at College of DuPage 

A* To determine its level of psychological si;vport 

B* T6 determine lAiether It vaa vllling to make a f Inancial/tlM 
ecamitment to the project 
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yi. With reference to the Oakland' Schools VRFP peraonikel 

Am To determine If they vere interested in having a pilot/ 
replication study done at College of IXiPage 

B« To determine if they foUoved throueli vlth the necessary si9pox*t 

VII. Vlth reference to the Director of the Developmental Learning 
Lflkb at the College of Dul^e 

A« To detexmine \ihether readability analyses vere Included in 
the responsibility of the reading consultant 

B« To determine vhether a portion of the consultant's tine 
would be conmltted to such a pilot study 

• VIII« With reference to the reading consultant at the College of DuF^e 

A« To determine tdiether she had mastered or could master the 
skills necessary to do the project 

B« Td determine idiether the size of the project vas too large 
for and individual to manage « 

Outcomes « vith reference to the faculty involved in the pilot project s Hine 
instructors vere approached to determine lAeUier they vanted to participate 
in the project* One used no text in his course and one said be had too fev 
students to make the replication valid* The other seven became the content 
Instructor participants in the project* 

Several of the content Ixistructors foUoved throue^ vith 'Uie Information 
provided: one is examining the level of bis language in his lectures; one 
revrote a portion of the text and sav hov it could be made more readablej 
one is determining vhether such a stiidy could be made at another college vith 
vhlch he is affiliated; and another asked the reading consultant to evaluate 
all the textbooks in his vocational program. !Ihis instructor is also using 
the Infoncatlon In an article he Is^. vrlting for a professional Journal* 
Outcomes - vith reference to faculty not directly Involved in ^e project * 

Two Ehglish instructors asked the reading consultant to administer 
the Otttes-lfacGlnitie test to classes vhich seemed to be having difficulty 



reading assignments in QigUsh* The tvo classes vere tested and a week later 
the reading consultant and English instructors Interpreted s<»De of the apparent 
findings to the classes* The students then took the coovuter printouts of 
their vrong answers and a copy of the test and decided yhy they made the 
errors they had made* The atoBt coimcm findings of the students vere: a lack 
of general vocabulary Information cotqpled vith an inability to use context 
clues; a lack of general Infoxnation; and a syndrome th^ identified as 
"psychological cop-out*" They found that if they predeteniined that they 
did hot know anything about the subject^ they did not even seriously try to 
answer the test iten* fbr exanq^le^ one series of items was concemed with 
chemistry* The students^ in some cases knowing they knew little about 
chemistry, did not try and did poorly* In going over the items, tenslnology 
from cooking was used In place of the diemlcal terms and the students found 
that th^ could easily supply the answers* Other non-project involved 
Instructors are considering using the computer program to evaluate 
materials they are writing, to evaluate students' writing, anc. to detemlne 
"hands on" literacy demands fbr students in vocational-technical areas* 
The accounting Instructors, after narrowing their selection of possible texts 
to two, asked the publishers for the readability levels of the books* Gkie 
text was 1^ grade level; the other ivas 12th* The instructors selected 
the text with the 12th grade readabiUty* 

OttfccMiea « referees students . Ih general, it is felt that the 

students were most cooperative* After their participation in the project 
was e^lained, they worked with the instructional team to provide valid test 
results* The students In the vocational-technical areas were sporatle in their 
response to the test results, themselves, but there vere seme req^ests for 
interpretation of the results* Many of the students scored much higgler than 
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they thou^ they V>uld and; aome attadents \ibo scored low are coming to the 
reading lab to develop their reading akllla* 

Outcomes • vlth reference to the Computer Services Department at the College 
of DttPtee # The cooQniter services personnel not only understood the Instructional 
implications of the program, but also suggested some further uses of the program, 
e«g* the possibility of using the readability analysis to study the students' 
vrltlng; the possibility of offering readability analyses to feeder hl^ 
schools In the district for use by thelztextbook adoption committees , thus 
broadening the commmity services of the colle£^« It was determined that 
readability analyses could be done at ^Uie college using existent equipment 
if re^prograaming vere done* Since ^le computer at the coU^e is in great 
usage, the Con^uter Priorities Coimaittee has heea created to establish^ 
programodng priorities* This leads to the next criterion for evaluation* 
Outcomes - vith reference to ^be administration * The reading consultant 
vas first introduced to the vork being done at Oakland Schools at 
tlie National Reading Conference In early December, 1972* la mld-Dececjber 
the Vlce«President, Program, at College of DuFage vrote to the Stverinte^ident 
of QpMand Sdiools requesting that the head of conputer services and the 
reading consultant visit during Christmas vacation* During the Interim 
the Vice President, Program; the Dean of Plaeulty: the Associate Dean, 
Vocational and Tedmical Program^ and the Head of the Conputer Services 
Departmert had not only been psychologically siqpportlTe, but also had 
provided the fUnds necessary for both a feasibility study and replication* 
The administrative si^port vas also evident iiben the project vas presented 
1^ the CoBQriter Priorities Cconlttee* At the time the reading consultant 
presented the project for a priority, the cooDlttee had requests before it 
for 3h veeks of programming time* Only kB veeks of time vera available# 



The computer conversion vould reqxilre another 6 weeks of time^ thus raising 
the requested time to 60 weeks* The coimlttee is large, conqposed of 12 
administrators representing various segments of the college population* 
Iinmedlately after presentation of the program request, the committee made 
several supportive comments and unanimously roted the reprogrammlng priority 
one* This directed computer services to begin programming immediately^. Ihis 
vote subsequently served as a further dissemlnatl' t. availability of 
the service and has influenced the choice of textbooks by faculty already* 
Outcomes - with reference to the Oakland Schools* VRPP personnel * The 
Oakland School and DuPage teams quickly decided that a replication was 
feasible and began work January 2, The Oakland Schools' ' team provided 
considerable support and encoiiragement at each step of the replication* 
They consistantly provi<||d Information and services not available at the 
coUepe* 

Outcomes - with refei'ence to the Diractor of the Developmental Learning 
|£d at the College of DuPage * The director detemilnes the scope of the 
responsibility of the reading consultant* 

Lnnediately after the NRC meeting^ the reading consultant described 
the work being done at Oakland Schools to her* She provided unconditional 
support for the reading consultant* Because she had' established the lab 
with maximum flexibility^ time was available for consultations with 
participating faculty and staff with no dlmunition in services to students* 
Without her understanding of the significance and Implications of the replication^ 
it would have been Impossible* 

Outcomes - with reference to the reading consultant * It was determined that 
the reading consultant^ a graduate of a traditional reading program^ with 
several years escperience in coiammlty college work^ had proficiency in 
the basic skills necessary for the replication* Ibr the more aophlstoteted 



aspects of the project, she relied heavily on the specialists in the other 
areas. Needless to say, she leained a lot. The final determination of 
whether a continuing operation of this type is too large for effective operation 
depends faculty usage of the program. 

Bmmary of outcomes 

1# A greater professiosial rapport vas developed between the faculty, 
administration, and students and the reading consultant. It is felt that 
the data generated by the replication concerning languaglng in the college 
will be of benefit, both directly and Indirectly, to the student s« 

2« The mean raw score for all the students taklxig the test, including 
the two English classes (n ■ 251) was 3^.kk (upper 13th grade level) « Eighty- 
three per cent of the students were in vocational«technlcal courses* 

3* The program was adopted for general use, but only as the result 
of the cooperative efforts of all of the persons involved. 
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TABLE 1 



Summary of Readability Analytes: Listini of Comparttoni Befwttn Student Reeding Ability 
and Textbook Readability for Courses Offered at the CoUefe of DuPage 
During the Winter Quarter of 1972 



NO. 


TEXTBOOK 


San 
Infori 

Topics 
Sampled 


iipling 

nation 

Nuinbcr of 
Words 
Sampled 


Readabil 
(Grade Equi< 
Rai^ ol 
Sample Topics 
(Low lo High) 


ity 

riient) 

l^sttmatcd 
Mean 
(95% Cdnndcncc 

Interval) 


1. 


Bohl 

Information Processing 


20 


6299 


10 to 16+ 


12 - 15 


2. 


Bohl 

Study Guide to Information Processing 


17 


1809 


11 to 16+ 


15 - 16+ 


3. 


Selman 

The Fundamentals of X-Ray and Radium Phys1< 


s 26 


6795 


9 to 16+ 


12 - 14 


4. 


Trane Air Conditioning Manual 


27 


10,810 


7 to 16+ 


10 - 12 
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